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SOLVING  INTERPOLATION  PROBLEMS  VIA  GENERALIZED 

EIGENVALUE  MINIMIZATION 


V.  Balakrishnan,  E.  Feron,  S.  Boyd1 
Department  of  Electrical  Engineering 
Stanford  University 
Stanford  CA  94305  USA 

Abstract 

A  number  of  problems  in  the  analysis  and  design  of 
control  systems  may  be  reformulated  as  the  problem 
of  minimiiiing  the  largest  generalized  eigenvalue  of 
a  pair  of  symmetric  matrices  which  depend  affinely 
on  the  decision  variables,  subject  to  constraints  that 
are  linear  matrix  inequalities.  For  these  generalized 
eigenvalue  problems,  there  exist  numerical  algorithms 
that  are  guaranteed  to  be  globally  convergent,  have 
polynomial  worst-case  complexity,  and  stopping  crite¬ 
ria  that  guarantee  desired  accuracy.  In  this  paper,  we 
show  how  a  number  of  important  interpolation  prob¬ 
lems  in  control  may  be  solved  via  generalized  eigen¬ 
value  minimization. 

1.  Introduction 

R  denotes  the  set  of  real  numbers.  C  denotes  the 
set  of  complex  numbers.  C+  denotes  the  set  of  com¬ 
plex  numbers  with  positive  real  part.  For  c  €  C, 
Sic  is  the  real  part  of  c.  The  set  of  p  x  q  matrices 
with  complex  entries  is  denoted  CpXq.  P *  stands  for 
the  complex  conjugate  transpose  of  P.  I  denotes  the 
identity  matrix,  with  size  determined  from  context. 
||P||  denotes  the  spectral  norm  (maximum  singular 
value)  of  P  €  CpXq,  defined  as  the  square-root  of  the 
maximum  eigenvalue  of  P*P.  The  matrix  inequali¬ 
ties  A  >  B  and  A  >  B  mean  A  and  B  are  square, 
Hermitian,  and  that  A  —  B  is  positive  definite  and 
positive  semi-definite,  respectively. 

A  linear  matrix  inequality  or  an  LMI  is  a  matrix 
inequality  of  the  form  D(x)  =  Do  +  >  0, 

where  are  given  real  symmetric  matrices,  and  the 
z,s  are  the  decision  variables.  We  will  use  the  term 
EVP  (GEVP)  for  the  optimization  problem  of  mini¬ 
mizing  the  largest  eigenvalue  (generalized  eigenvalue) 
of  a  symmetric  matrix  (pair  of  symmetric  matrices) 
that  depends  affinely  on  the  decision  variables,  sub¬ 
ject  to  linear  matrix  inequality  constraints.  EVPs 
(GEVPs)  are  convex  (quasiconvex)  nondifferentiable 
optimization  problems;  therefore  there  exist  readily 
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derived  necessary  and  sufficient  optimality  conditions 
and  a  well-developed  duality  theory.  Moreover,  the 
fundamental  computational  complexity  of  these  prob¬ 
lems  is  low,  in  particular,  polynomial- time.  Thus 
EVPs  and  GEVPs  are  tradable. 

There  exist  a  number  of  general  algorithms  such  as 
the  ellipsoid  method  that  are  guaranteed  to  work  for 
EVPs  and  GEVPs.  More  recently,  a  number  of  very 
efficient  interior  point  methods  have  been  proposed 
for  these  problems.  We  refer  the  reader  to  [1,  2]  for 
more  details. 

Several  important  problems  in  the  analysis  and  de¬ 
sign  of  control  systems  may  be  reformulated  as  EVPs 
and  GEVPs  (see  [3]  and  the  references  therein).  In 
this  paper,  we  will  show  how  a  number  of  important 
interpolation  problems  in  control  are  equivalent  to 
generalized  eigenvalue  minimization  over  linear  ma¬ 
trix  inequalities. 

2.  Tangential  Nevanlinna-Pick  problem 

Given  Ai,...,Am  with  A*  €  C+,  tij,...,um,  with 
m  6  C’  and  »i, . . . ,  vm,  with  €  Cp,  i  =  1, . . . ,  m, 
and  Af  >  0,  the  tangential  Nevanlinna-Pick  problem 
is  to  find,  if  possible,  a  function  H  :  C  — »  CpXq  which 
is  analytic  in  C+ ,  and  satisfies 

H(Xi)ui  =  Vi,  i  =  1,...  ,m  with  ||JT||oo  <  M. 

(HJTIIoo  denotes  the  Hoc-norm  of  H,  which  is  defined 
as  supwgj^  ||AT(ju))||.)  This  problem,  which  arises  in 
multi-input  multi-output  Hoo -control  theory  [4],  has 
a  solution  if  and  only  if  there  exist  G;n  >  0  and  Gont  > 
0  such  that  the  following  equations  and  inequality 
hold. 

A*Gin  +  GinA-VU  =  0, 

A*  Gout  +  Gout  A  —  V*V  =  0,  (1) 

M2Gin  —  Gout  >  0, 

where  A  =  diag(Ai, . . . ,  Am),  U  =  [«i  •••  um]  and 
V  =  [®i  •  •  •  «„].  Finding  the  smallest  M  such  that 
there  exist  Gj,  >  0  and  Gout  >  0  satisfying  (1)  is  a 
GEVP  with  variables  G-in  and  Gout-  In  fact,  it  is  a 
simple  generalized  eigenvalue  calculation. 
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3.  Ncvaalinna-Pick  problem  with  sealing 

Given  Ai,...,Am  with  A*  e  C+,  with 

u<  €  C*  and  with  t>;  e  C7,  i  = 

the  problem  is  to  find 


H  analytic  in  C+ 

D  =  D*  >0 

||  DHD-'U 

Dev 

H(Xi)ui  =  ti 

I  ■”  »  j  TTt 

where  V  is  typically  the  set  of  diagonal  or  block- 
diagonal  matrices. 

This  problem  corresponds  to  finding  the  smallest 
scaled  HK  norm  of  all  interpolants.  This  problem 
arises  in  multi-input  multi-output  Hoc -control  syn¬ 
thesis  for  systems  with  structured  perturbations  [5]. 

With  a  change  of  variables  P  =  D*D,  yopt  may 
be  determined  as  the  smallest  positive  Af  such  that 
there  exist  P  >  0,  P  €  V,  Gj„  >  0  and  Goat  >  0  such 
that  the  following  equations  and  inequality  hold. 

A*Giu  +  GiBA-U*PU  =  0, 

A*G0ut  +  GoutA  -  V*PV  =  0, 
M'Gia-Gomt  >  0, 

where  A  =  diag(Ai, . . . , Am),  U  =  [tq  •  •  •  u*.]  and 
V  =  [ri  •  •  •  t>m].  This  is  a  GEVP  with  variables  P, 
Gi„  and  Get- 

4.  Frequency  response  identification 

Consider  the  problem  of  identifying  the  transfer 
function  E  of  a  single-input  single-output  linear  sys¬ 
tem  from  noisy  measurements  of  its  frequency  re¬ 
sponse  at  a  list  of  frequencies  [6]:  Given  and 
fi  =  H(jui)  +  n,-,  *  =  where  n<  are  the 

(unknown)  noise  values,  the  problem  is  to  identify 
H(b). 

H  may  be  required  to  satisfy  some  constraints, 
which  may  arise  from  information  about  the  system 
known  a  priori,  or  may  reflect  properties  desired  of 
the  identified  system,  consistent  with  measurements, 
such  as 

1.  H  is  analytic  in  Rs  >  —a  with  a  >  0. 

2.  The  a-shifted  Hoc  norm  of  H,  defined  as 

HJTIkoc  =  supRj>_0  ||F(s)||  does  not  exceed 

Af. 

3.  The  noise  values  satisfy  ||n||  <  e. 

(Or  ||n|| 

oo  —  maxx<j<ra  |«i |  <  t.) 


From  Nevanlin  na-  Pick  theory,  there  exist  H  and  n 
with  E(ui)  =  f%  +  satisfying  conditions  (1-3)  if 
and  only  if  there  exist  n  satisfying  (3),  Glm  >  0  and 
G0»t  >  0  such  that 

(A  +  or/)*  Gja  4-  Gu  (A  +  ail)  —  e*e  =  0, 

(A  +  or/)*  Go«t  +Go«t  (A  +  oJ)  — (/  +n)*(/  +  n)  =  0, 
Af*G u  -  GMt  >  0, 

where  A  =  diag(M, . . . ,  jum),  e  =  [1  •  •  •  1],  /  = 
[fi  ■  •  •  fm]  and  n  =  [nj  •  •  ■  nm].  It  can  be  shown 
that  these  conditions  are  equivalent  to 

Af  *G|a  —  Goat  ^  0 

(A  +  alY  Gta  +  Gi.  (A  +  ai)  -  e*e  <  0 
(A  +  a/)*  Go.t  +  Go.*  (A  +  ai)  -  (/  +  n)*(/  +  n)  >  0 
with  n*n  <  e*  (or  |nt|  <  e,  i  =  l,...,m). 

With  this  observation,  we  may  answer  a  number  of 
interesting  questions  in  frequency  response  identifica¬ 
tion  by  solring  EVPs  and  GEVPs. 

For  fixed  a  and  e,  minimize  M.  Solving  this  GEVP 
answers  the  question  “Given  a  and  a  bound  on  the 
noise  values,  what  is  the  smallest  possible  a-shifted 
Hoc  norm  of  the  system  consistent  with  the  measure¬ 
ments  of  the  frequency  response?” 

For  fixed  a  and  Af,  minimize  e.  Solving  this  EVP 
answers  the  question  “Given  a  and  a  bound  on  a- 
shifted  Hqo  norm  of  the  system,  what  is  the  “small¬ 
est”  possible  noise  consistent  with  the  measurements 
of  the  frequency  response?” 
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